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I recently went through the Excellence in Research for Australia evidence gathering process. The measurement of creative work as 
research output as part of this process has raised a number of issues for me, as a creative scholar, which I feel will be useful to share. 


Introduction 

‘The Excellence in Research for Australia (ERA) initia¬ 
tive assesses research quality within Australia’s higher 
education institutions' (Australian Research Coun¬ 
cil, 2010 p.l). In 2009 a trial of the ERA evaluated 
physical, chemical and earth sciences, and humani¬ 
ties and creative arts clusters. The identification of 
the creative arts first recognised during the Research 
Quality Framework process (set up by the previous 
Federal Government to assess research quality), signals 
acknowledgement of the growing importance of the 
creative arts as a discrete area of research. The spot¬ 
light on creative arts presents many opportunities but 
has also highlighted the complexity of measuring the 
arts as research. 

Various creative arts have had a place within univer¬ 
sity life where they have been celebrated and studied, 
however the systematic training of future creative art¬ 
ists has been a relatively recent development. In Aus¬ 
tralian universities, the introduction of creative arts 
might have been due partly to structural changes with 
the government directed college and university amal¬ 
gamations in the 1980s (Wright,Bennet & Blom, 2010). 
However student interest in training for theatre, fine 
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arts, creative writing and screen production saw many 
universities around the world developing and main¬ 
taining areas of creative arts courses, usually within 
the humanities. 

Industry practitioners and creatives’ were often 
brought into the academy to teach specific technical 
skills and oversee projects while existing humani¬ 
ties academics taught related liberal arts subjects and 
research skills. Media studies departments developed 
alongside journalism degrees, sometimes within lit¬ 
erature departments. Traditional academics continued 
their own research output while drawing on increased 
student numbers from the ‘popular practical’ courses. 
Practitioners used their research time to continue cre¬ 
ative endeavours and/or industry/arts affiliations. 

The separation of practice and theory is artifi¬ 
cial and continues to be a fractious border between 
departments and ideologies. On the one hand, aca¬ 
demics from a traditional research background have 
increasingly explored facets of the creative arts includ¬ 
ing textual analysis, culture and industry. Works of art 
and craft have always been objects and texts for study. 
On the other hand, the creative and industry trained 
academics have been increasingly encouraged to com¬ 
plete higher degrees. There has been a correspond- 
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ing rise in undergraduates undertaking honours and 
higher degrees in the creative arts, often with a crea¬ 
tive component. Some university trained artists, and 
artists as university academics, are now using theoretic 
frameworks in order to produce research of their own 
in the creative arts. Others continue just to teach and 
produce their art. 

ffowever, understandings concerning practice - that 
is the processes and techniques used by creative art¬ 
ists and craft persons in order to create - have been 
largely ignored by both the creative academic (often 
assuming them) and the traditional researcher (often 
denying their existence.) 

The need to articulate and validate creative practice 
has been made more urgent by the inclusion of the 
creative arts in the ERA process.The proof of research 
quality is tied to government funding and universities 
have strategically sought to increase their share of 
funding by targeting their own research output.A vari¬ 
ety of research fields have been working through their 
own unique methods and discussing the decisions of 
criteria, especially regarding the ranking of journals as 
a measure of quality. Traditional researchers are con¬ 
fronting problems within these new definitions and 
alignments. 

The creative arts are also working through a vari¬ 
ety of complexities of measurement including those 
of collaborative works such as in music, dance, thea¬ 
tre and screen production. For instance, consideration 
is being given to the weight of contributing artists 
to the finished collaborative art works and there are 
also difficulties to face in proving and validating live 
performances. Some things are common amongst the 
creative arts and some vastly different. We may readily 
agree that a dance is not a painting, but the varieties of 
measuring criteria that derive from this obvious obser¬ 
vation are manifold. And some creative fields are more 
advanced than others in the language that is used to 
articulate output. 

However, it is in the practice of creative art where 
some of the greater difficulties of definition are emerg¬ 
ing. Some of this difficulty derives from the historic 
place of the creative arts within the humanities and 
the existing expertise in the critical study of creative 
artefacts and consequent adherence to a qualitative 
methodology. ‘Established qualitative and quantitative 
research methodologies frame what is legitimate and 
acceptable,’ aligning different approaches to measure¬ 
ment (Haseman, 2006).This is of course an oversimpli¬ 
fied dichotomy. A variety of combinations of qualitative 


and quantitative approaches to research have also 
proven useful, as well as other recognised research 
methodologies such as action research and participa¬ 
tory research. 

However, in the creative arts (and health sciences) 
practice-led research (also known as practice-as, 
practice-based, mixed-mode) is an emerging tool for 
exploring certain kinds of creative work. It involves a 
combination of theoretic research and propositional 
thinking in combination with a creative work, per¬ 
haps answering the same proposal/question, often 
with some critical reflection concerning the proc¬ 
ess and efficacy of the result. In many respects it is 
experimental in approach. In terms of student work 
within the academy there is an exegetic component 
and a creative work. (Leahy, 2009; Kroll, 2008) Rela¬ 
tive weighting concerning the quality and interplay 
of the components can vary between institutions 
and of course between departments within the 
same university. 

The validity of practice-led research continues to be 
a subject of debate, not so much within creative areas 
as with the committees of traditional research fields 
who oversee research output. Pressure continues to be 
placed on creative academics to conform to a tradi¬ 
tional humanities qualitative methodology even when 
the existence of a practice-led model is acknowledged, 
forcing research to be ‘about the arts rather than of 
them’ (Kroll, 2008). And this raises a further crucial 
question regarding the practicing artist within the uni¬ 
versity. To what degree is creative output the actual 
research output and not just an addendum, parallel or 
tangential to the real research? What is the status and 
value of discoveries made in the studio’ and what are 
valid ways of articulating those discoveries? 

The ERA process has focused the notion of meas¬ 
urement on the creative arts and it is up to practic¬ 
ing creative academics to articulate the standards and 
defend the validity of the way ‘creatives’ also create 
new knowledge. It is an opportunity to argue that the 
process of creative text creation is a form of research 
output in itself, not merely a text that is analysed con¬ 
ceptually, somehow before it exists. 

This paper is intended as a case study focusing on 
my own experiences in being measured for the ERA. 
It is therefore, necessarily personal.Yet, I seek to share 
the fruits of this encounter and subsequent analysis 
with creative and traditional researchers in the belief 
in common ground rather than difference. Please bring 
your own paint brushes. 
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Painting Monkey 

I was a practicing film and television director and screen¬ 
writer for some twenty years, during which I directed 
for ABC television, directed a feature film, wrote an AFI- 
nominated telemovie and wrote amongst other things, 
many hours of children’s television. Approximately 
seven years ago, I took a position at Curtin University 
where I teach production and writing. I continue to 
write for television with the blessing of my school and 
have recently written a novel entitled Spinner. 

There is a video clip on YouTube: Painting monkey, 
accessed on 11 February 2011 at <http://www. 
youtube.com/watch?v=i_qlt_qbfYw>. A zoo keeper 
gives a monkey some paints and the monkey uses 
a brush to smear paint on a page and eventually on 
the back of the keeper. I 
have come to identify with 
this monkey. It is, I believe, 
how I am seen by those 
people within my univer¬ 
sity who collected data on 
my research output for the 
ERA process. 

There’s another video 
clip from YouTube, Painting 
elephant, accessed on 27 
July 2011 at <http://www. 
youtube.com/watch?v=He7Ge7Sogrk>.A keeper leads 
an elephant to an easel and gives it paint. The elephant 
takes the brush and slowly, but clearly paints the out¬ 
line of an elephant. You can hear tourists gasp as the 
likeness emerges. I have come to realise that it would 
be easier to measure my creative output for the ERA 
if I were more like the painting elephant rather than 
the painting monkey. Clearly, the elephant is painting 
another elephant.This is a talented elephant. Concern¬ 
ing the monkey’s skill, I’m not so sure .There’s paint and 
there’s a brush, but the monkey’s daubs and smears, 
while colourful, do not look like another monkey... or 
an elephant. 

I’d like to use a number of my creative works, includ¬ 
ing my novel, Spinner and an episode written for the 
television soap opera 'Home and Away' to explore 
creative research and measuring output especially in 
regards to the multiple disadvantaging of the academic 
artist. In doing so, I hope to also defend the place of 
the painting monkey in the Academy. 

The ERA asked that creative works be accompanied 
by a research statement. This statement needed to 
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include Research Background, Research Contribution 
and Research Significance. While it is encouraging that 
creative work is being counted as research, the models 
used to measure it are inappropriate. In order to answer 
these statements, it was necessary to heavily massage 
descriptions of creative work so they complied. 

The University of Sydney (2010) offered suggestions 
in its Research Statements for Creative Works Submit¬ 
ted for Peer Review which my university used. Under 
the heading Research Background it was suggested I 
use one sentence to explain the research field and tra¬ 
dition, then a sentence explaining the works aim and 
intent, especially in terms of a gap in the knowledge. 
Finally I was asked to write the research question’. 

Research questions can be useful tools in research 
of a certain kind - certainly at say Honours level where 
relatively simple questions 
can lead to simple answers 
within a known field. They 
are sometimes useful in 
formulating creative works 
but they are not always 
the most useful approach 
for creative projects, even 
for students. (Combrink & 
Marley 2009; Boyd 2009) 

I certainly had no 
research question when I 
approached my novel, Spinner. Now, you can attempt 
to simplify the process, in retrospect if you wish, but I 
promise you I had no clear question in mind. I jumped 
in’. I had an idea about a twelve year old who might be 
the greatest cricket spin bowler in the world. For a vari¬ 
ety of reasons which I don’t have time to go into here, I 
placed my story in the later 1920s. I decided on a quest 
structure based on previous work and readings such as 
Vogler’s The Writer’s Journey (2007). I embarked on 
research into the historic period in Australia and West¬ 
ern Australia. I also researched spin bowling and cricket 
techniques. In terms of narrative and story structure, 
I drew on a great many films, literary works and my 
experience as a screen writer. I soon discovered I also 
needed to research elements of the First World War. 

As Jeri Kroll in Creative Practice and/as/is/or 
Research:An Overview (2008) cites Tripp (2003), ‘we 
see a cycle of asking questions, generating methodol¬ 
ogy, collecting data, creating, revising, reflecting, and 
modifying practice, which then moves to another level 
to clarify significance through systematic (or theoreti¬ 
cal) evaluation’ (Kroll 2008, p. 6). 
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In creating works it is not so much a single research 
question but ‘a conversation'. This model explaining 
the creative process as a kind of research comes from 
Donald Schon’s Double Loop Thinking which was first 
applied to business practice. Nicola Boyd in A Creative 
Writing Research Methodology’ (2009) actually draws 
this non-linear process as a spiral. She also uses the 
Escher drawing, Drawing Hands, to highlight this ongo¬ 
ing interactive process of realisation. (Boyd pp. 7-8) 

Many questions arose during the act of writing 
Spinner. I had never written a novel before. I wrote it 
outside direct Academic mentorship. In fact the novel 
was written without a specific sage or tutor.That is not 
to say in a critical vacuum. I studied literature at uni¬ 
versity. I know what point of view is. I know what 
the term unreliable narrator means. I understand the 
term willing suspension of disbelief. I do know what 
things are called. More importantly, I have read a lot of 
novels. But I entered the writing of this novel as a trial 
and error process. For instance, I spent three whole 
chapters describing my character’s first test match - 
and I think it works. It’s there in the finished novel. 
But when it came to the next match, I didn't want to 
go there again in the same way. Call it instinct, or the 
sum total of experience and learning, but I got bored 
with telling that part of the story in that same way. 
Maybe the reader might get bored too. (Again, this is 
a Schon concept. These issues are widely explored, I 
believe, but I found Steven Scrivener’s Reflection in 
and on Action and practice in creative production 
doctoral projects in art and design (2000) and Hart 
Cohen in Knowledge and a Scholarship of Creativity 
(2009) also useful.) 

The solution to that problem also solved another 
problem. I wanted to break out of the limited point of 
view from which I’d been telling the story, that is from 
a naive twelve year old perspective, for some three hun¬ 
dred pages. This solution led to another discovery and 
to a key issue of Spinner. The finished novel is about 
story telling as well as the story, diegetic and ultimately 
self-reflexive. The spinner is a cricket bowler, but his 
uncle is a spinner of tall tales, as is the novelist. Yet I 
had no conception that this story would become about 
story telling itself until the decisions around page three 
hundred. And this meant returning to the beginning 
and teasing out some latent threads there too. 

These series of questions arose and were shaped 
and experimented with and amalgamated. And they 
came not from a set survey of the field (although by 
implication that occurs) nor by any consideration of 
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the gap in the field (although I didn’t think there was a 
book around like it), but as Brad Haseman puts it in A 
Manfesto for Performative Research (2006), by jump¬ 
ing in. 

Incidentally, a most useful article for those interested 
in the academic artist is The Interface between arts 
practice and research: attitudes and perceptions of Aus¬ 
tralian artist-academics’ by Wright, Bennett and Blom 
(2010). They survey the field in Australia and demon¬ 
strate art as research before interviewing a number 
of academics working in the creative arts. The notion 
that dance choreography operates on this same model 
is illustrative in terms of the process being part of the 
output, but is also the research - which also involves 
collaboration and experimentation. The other really 
useful article I found amongst the many grappling with 
art as research is by Combrink and Marley called Prac¬ 
tice-based research: tracking creative creatures in the 
research context’ (2009). It has a great survey of works 
on practice based research and develops a model of 
what practice-based research might look like. 

Of course, the above aside does make explicit some 
of the research contribution and background which 
has contributed to this paper. Even in attempting to 
refute the research question model, I have become 
a painting elephant. But here’s the thing. I shouldn’t 
have to. 

I grant that reflective practice is a useful model for 
our creative students... even our PhD students. Part 
of the learning is an awareness of a variety of method¬ 
ologies and processes and kinds of research and prac¬ 
tice being used in creating the work and commenting 
on both the work and the act of creating. This is most 
useful when training creatives as well as scholars. It is 
not the only way, but perfectly valid. 

In fact, it would be quite strange to ask a student to 
create a work and then write an exegesis but forbid 
them to comment on their work. This would deny the 
learning process in creating the work and the research 
gained from all stages of the process. 

However, I claim to be a grown up. I’ve directed 
nationally and written internationally for decades. I’ve 
taught for nearly another decade. I have knowledge. I 
have methodologies and am aware of others. I reflect. 
Why is the ERA now asking me to demonstrate this? 

Wright, Bennett and Blom (again) cite Gye citing 
Professor Ross Gibson, who says ‘It [ERA] will benefit 
artists who are able to engage in some extra, fairly tra¬ 
ditional routines of academic scholarship, adding some 
linguistic discourse onto their productions. The ERA 
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probably won’t benefit artists who happen to teach in 
academies but who are not that interested in being the 
new-style creative arts academic. The rules are pretty 
clear - knowledge has to be explicit and communi¬ 
cated’ (Wright, Bennett & Blom, p 472). 

My criticism is that it has to be explicit and com¬ 
municated in a way that someone who is not in my 
field will accept. This is akin to demanding liquid 
volume can only be expressed in linear metric units of 
measurement. In other words the knowledge must be 
translated into the language of the traditional research 
scholar... not left in the language of the creative 
medium in which it was created. 

I'll come back to this because I believe other issues 
in the ERA measurement may help in articulating 
this notion more clearly. The ERA’S next category is 
Research Contribution in which the creative must 
explain why their work is innovative and original. 

How original? In what way original? I would not 
know where to begin in explaining Spinner' s original¬ 
ity. It seeks to be familiar in many ways. What if it were 
less different? How would you quantify the innovation 
of Baz Lurhman in Romeo and Juliet to someone who 
didn’t understand film making or Shakespeare? It’s an 
old play, been done to death really - and Lurhman uses 
pastiche rather than new forms. Remember, you’re 
only allowed a couple of sentences. There was this 
artist once who put a urinal up on an art gallery wall. I 
don’t believe Duchamp would be able to explain him¬ 
self adequately to the ERA. How many words would 
you need to spend to explain the originality (and I 
believe it was) of a reproduction of a Campbell’s soup 
can? And the reproductions of the reproductions? I 
don't know whether Spinner is original, but I am sure 
I will find a way to massage it into that category for 
my next academic demonstration of research output. 

I have no choice. 

There were a number of other double standards I 
encountered within my university's collection of data 
for the ERA measurement which I would also like to 
highlight. (I should make clear at this point that I dealt 
with a team within my university charged with assist¬ 
ing in the collection and measuring. These people 
answered to others within the humanities, who I am 
sure, worked upwards again. I acknowledge that I 
have no way of knowing what the ERA may or may not 
have judged, but only the face of that encounter within 
my own university). 

First, I was only able to enter a number of episodes 
I wrote on one particular television series as one item. 


E R S I T I E S 

Although I was part of the children’s drama television 
series creation of Parallax and wrote five of the first 
six episodes and a number of other episodes including 
the last, episode 26 (which is an honour in the televi¬ 
sion industry), this was only counted as one research 
output. Effectively, the first episode I write is full of 
research and is an output of that, but subsequent epi¬ 
sodes are like those mass produced soup cans or pho¬ 
tocopies of the first. 

I began to see a pattern. Or should I say a repeated 
absence - a void.The process of the artistic output was 
being counted neither as research nor as output. And 
if you don’t count narrative, character, drama, themes 
and episodic convention mastering, then you are actu¬ 
ally only measuring the traditional research topic com¬ 
ponent of the work. So instead of Parallax being an 
extended twenty five minutes multiplied by the eight 
episodes, which would be a four hour explication of 
the research - it is only counted as the first twenty five 
minutes ... and nothing.The other episodes don’t even 
have echo status. 

Let me move to the measurement of two of my epi¬ 
sodes of Home and Away (episodes 3,518 and 3,519). 
You’re smiling. Me too.That’s a lot of episodes.And I’m 
going to have to demonstrate originality? Significance? 
It’s already low rather than high culture - (unlike the 
novel, of course). 

If I had a research question for my episodes for 
Home and Away, it would have been something 
as general as Can I write an episode of soap?’ I was 
honoured to be asked actually, by someone I knew, to 
write for this internationally televised war horse of the 
industrial model of television story telling - extreme 
long form drama. It’s hard to get a gig on television 
shows, but I also understand a little derision. It ended 
up not my cup of tea either. 

But I studied the show. I examined other television 
soap operas. I met with the story designers and other 
writers, and I wrote three episodes following the story 
lines provided.And I used my years of practice in writ¬ 
ing for many other television shows. Is it innovative? 
Perhaps not. But is episode 3,518 of Home and Away 
less original than article 2,500 on Thomas Hardy? Why 
should an esteemed colleague have to go through 
enormous gymnastics to demonstrate that her fifth 
novel is not just another one about old ladies in love, 
when another colleague is lauded for his 50th article 
on Shakespeare without the same demand to explain? 

The reaction of the ERA proof collection team to 
Home and Away was very illustrative in terms of 
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coming up with a research question. My research could 
not be into soap opera writing because my scripts 
were not deemed to be an output, but rather a delivery 
system, a little like a telephone line, perhaps. There 
was a tiny element of alcohol abuse by one character 
and a little tough love given by whatever doctor was in 
the show at the time, so it was helpfully suggested that 
my research question be,‘How can this entertainment 
oriented television genre be used to convey crucial 
social messages regarding teenage alcohol abuse and 
make an impact on a mass television audience?’ 

Worthy, yes. True? No. I declined the assistance on 
this output. However, the pattern was being repeated. 
Research was only being perceived in terms of topic, 
not in terms of the process of creative work. Alcohol¬ 
ism is a research topic. Writing soap isn’t apparently. 
The process is denied in the explication. Only the 
traditional research components are seen and easily 
made explicit and communicated. It needs to look like 
an elephant. 

Here is something you won’t encounter in a scene 
from Home and Away.' Foucault’s archaeology of the 
emergence of modern, Western man as a problem 
of finitude, inextricable from its afterbirth, its Other, 
enables the linear, progressivist claims of the social 
sciences - the major imperialising discourses - to 
be confronted by their own historicist limitations’ 
(Bhabha, 1994 pp 46,47). 

The passage clearly needs some serious unpacking. 
Why doesn’t Bhabha have to explain? I’m not asking 
that he do, by the way. In other contexts, he has. 
And we accept that some degree of expertise needs 
to be brought to most academic writings. However, 
we might also apply that understanding to the crea¬ 
tive scholars. The academy might stop treating me for 
instance as a dim witted honours student, and consult 
an expert in Home and Away. Let’s call that person a 
peer: a peer in television writing by the way and not 
one in watching. This peer is most likely not going to 
be a cultural theorist. 

In effect, not only are creatives being called on to 
go through extra stages of explication and communi¬ 
cation, but we must also deny the value of the crea¬ 
tive process itself and only highlight the traditional 
research components, expending double the work and 
half the kudos. 

I think there are things that can and need to be done 
towards establishing a fairer measurement of creative 
output as research output. This paper is an attempt to 
contribute to that discussion. 
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In terms of screen practice, a number of Australian 
universities have sought to develop their own peer 
assessment process in order to provide expertise in 
the measurement of creative output. The Australian 
Screen Production, Education and Research Associa¬ 
tion (ASPERA) have developed national peer assess¬ 
ment panels for screen projects (Diegetic Life Forms 
II, 2010). All scholars working in creative areas need 
to build or strengthen peer reviews, which stand up to 
outside scrutiny. In the short term this may require a 
lot of extra work from practitioners. 

But artist academics must also continue to argue 
with the traditional research academics concerning 
creative output as research output. We need to gather 
together some of the work being done around the 
world on practice as research and creative work AS 
evidence of research output, which I felt I needed to 
do as a consequence of my inability to engage with 
the ERA proof collectors at my university. I hope some 
of the readings mentioned are useful to other creative 
scholars in framing legitimacy and parity. 

I also care for selfish reasons. I teach and am happy 
to do my share. But I want to keep my research day. 
The ERA is converted to my university’s research 
points system called the Research Performance Index. 
By these guidelines, a non-fiction work of scholarship 
is worth 500 points, whereas Spinner as a creative 
work is worth 150 points. (This value was changed in 
2011 to 225 points for a novel, but only if the publi¬ 
cation is deemed equivalent to certain journal rank¬ 
ings). If I have to produce the work, then write about 
the work and then only count some of the work and 
then only get credits for one fifth of the work, my 
likelihood of proving I am a productive researcher is 
significantly reduced. I will lose my research day, and 
therefore lose my space to be creative while teaching 
in the academy. 

This is also a loss to my university. Outside of under¬ 
graduates wanting lecturers who have and do make 
films in a screen arts course, there are a variety of 
values in enhancing the stock of human knowledge 
in human experience, not just facts and not just in 
short term economic terms. Indeed Wright, Bennett 
and Blom point to Krieger’s Social Science and the 
Self { 1991) concerning the need of social science that 
is ‘soft, subjective, idiosyncratic, ambivalent, conflicted, 
about the inner life, and about experiences that cannot 
be measured, tested or fully shared.’ 

As Edward de Bono says in How To Have Creative 
Ideas (2007, p.8), ‘Our culture and habits of thinking 
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insist that we always move towards certainty. We need 
to pay equal attention to possibility.’ 

I’d like to go out on another image: it’s from the 
documentary Who the #$&% is Jackson Pollock? 
(Moses, 2006). It’s a clip of him painting. For those of 
you who don’t know his work, it is quickly plain that 
he is not painting anything that looks like an elephant. 
He smears and trickles and splashes and flings. The 
images, of course, evoke the impenetrability of the 
painting monkey. I don’t know much about art, but 
people who do say his work is significant. This is dif¬ 
ficult to measure, of course. 

Ron Elliott is a lecturer in Film, Television and Screen Arts 
at Curtin University, Western Australia. 
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